Percolation-like behavior of some optimal coalition formation models 
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The ground-state of an infinite-range Potts glass-type model with ±J bonds and unrestricted 
number of states is used to investigate coalition formation. As a function of the q probability of -I- J 
bonds in the system it is found that the r relative size of the largest cluster (a cluster being the 
group of elements in the same state) shows a percolation like behavior. By a simple renormalization 
approach and several optimization methods we investigate the r(g) curves for finite systems sizes. 
Non-trivial consequences for social percolation problems are discussed. 

87.23 Ge (Dynamics of social systems), 75.50.Lk (Spin glasses and other random magnets) 



I. INTRODUCTION 

The Potts glass was originally introduced for study- 
ing various non-magnetic random orientational and 
structural ^ glasses, which do not posses reflection or 
rotational symmetries. Apart of the specific solid-state 
and statistical physics applications, the infinite-range (or 
mean-field) version of the model recently received re- 
newed interest from the view-point of coalition forma- 
tion phenomenon in sociological systems |^,^,^. From 
this perspective the primary interest is in the ground- 
state of the infinite-range (or mean-field) p-state Potts 
glass. 

The infinite-range p-state Potts glass is usually defined 
by the Hamiltonian: 

H = -p'^JtjSa{i}a(j) (1) 

i<j 

The a{i) Potts states can take the values 0, 1, 2 ,p— 1. 

The sum is extended over all N{N — l)/2 pairs in the 
lattice, Smn = 1 if m = n and Smn = otherwise. 
The Jij bonds are randomly distributed quenched vari- 
ables with Jo/N mean, and the variance is presumed 
to scale as N~^. The system has a non-trivial frus- 
tration and computing the thermodynamic parameters 
is a complex task. The above model has been exten- 
sively studied by many authors through different meth- 
ods |,|,|,|Jl|,|l5,|ll,|l|,|ll. Within the replica theory a 
self-consistent description of the low-temperature glassy 
phase was obtained [|[@. For p > 2 and low enough 
temperatures it was found that the infinite-range 

Potts glass is finally always ferromagnetic. Here we con- 
sider a special case of the infinite-range Potts glass, which 
can be useful in understanding some universalities for 
coalition formation phenomena in sociological systems. 
The main difference between the original Potts glass and 
the model studied here is that we we consider an impor- 
tant class of the Jij bonds, where the variance scales as 
N^^. Also, we consider unrestricted number of p Potts 



states {p = N), and restrict the study on the ground- 
state (r — 0). In the N oo limit an interesting 
percolation-like transition is then revealed which is stud- 
ied by different approximations for finite system sizes. 

II. THE MODEL 

In order to describe the process of aggregation or 
coalition-formation phenomena in politics, economics or 
sociological systems we introduce a model similar to the 
original Potts glass model. In such a system given a set 
of N actors (in our case the Potts variables) we define an 
associated distribution of bilateral propensities towards 
either cooperation or conflict The actors might be 
countries which ally into international coalitions, compa- 
nies that adopt common standards and strategies, parties 
that make alliances, individuals which form different in- 
terest groups, and so on. The propensities will define 
the Zij interactions between the actors. The Zij bond is 
positive if there is a tendency towards cooperation and 
negative if it is a conflicting relation between actor i and 
j. For simplicity reasons let us assume first that the 
Zij links are symmetric {Zij = Zji), however later the 
case without this assumption is also considered. In ad- 
dition to this, each actor has an S'i > weight-factor 
which characterizes its importance or size in the society. 
This may be a demographic, economic or military factor, 
or an aggregate parameter. The question then arises as 
what kind of coalitions are formed in order to optimally 
satisfy the conflicting interactions. In particular we are 
interested in the size of the largest cluster in the optimal 
state. 

This non-trivial optimization problem can be math- 
ematically formulated in the formalism of a zero- 
temperature Potts glass type model. To prove this, we 
define a cost-function, K, (a kind of energy of the sys- 
tem) that is increasing with SiSj \ Zij \ whenever two 
conflicting actors (i and j) are in the same coalition or 
two actors which have a tendency towards collaboration 



1 



are in different coalition. The cost-function is zero, when 
no propensity is in conflict with the formed coalitions. 
The number of possible coalitions is unrestricted (maxi- 
mal possible number is N), and we denote the coalition 
in which actor i is by cr(i). The cost function then writes 
as: 

K — - ''^S„(^i')c{j)ZijSiSj + ■^''^{ZijSiSj+ I ZijSiSj I), 

i<j i<j 

(2) 

It is immediate to realize that for a given distribution 
of the Zij interactions and Si weight-factors the sec- 
ond term in equation (|^) is constant (independent of the 
formed coalitions). Minimizing the K cost function is 
equivalent with finding the ground-state of the (|l|) Hamil- 
tonian with p = N. Instead of StSjZij we now introduce 
the JijN notation. If Zij and Si are independent of N 
we have that < Jij > scales as N~^, and we introduce 
the notation: Jq = N < Jij >. We consider now a some- 
how trivial but practically important and general case, 
when the variance of Jij scales as iV~^. (As an imme- 
diate example for this scaling is the simple case when 
Si = Sj = 1 and Zij is -f 1 with a probability q and —1 
with a probability 1 — q.) For this choice, the N oo 
thermodynamic limit becomes simple, since the disorder 
in the system scales out. The infinite-range Potts glass 
becomes thus equivalent with a simple mean-field Potts- 
model, with Jq interactions between the elements. While 
for Jo > the system has minimal cost function when 
all elements are in the same coalition, for Jg < in the 
ground-state each element has to be in a different coali- 
tion. As a function of Jq a transition is thus expected. 
This transition resembles the one obtained in percola- 
tion or random graph models. Since the temperature 
has no role in this phenomenon, we call it geometrical 
phase transition. In the present paper we study this ge- 
ometrical phase transition for finite N values and simple 
Jij distributions. The finite N limit is however not as 
simple as the thermodynamic limit. Frustration effects 
are important and finding the ground-state is a complex 
NP hard optimization problem. (It is believed that for 
large N the number of steps necessary for an algorithm to 
find an exact optimum must, in general, grow faster than 
any polynomial in N.) Several methods were used to in- 
vestigate finite-size behavior in the expected transition. 
First a simple renormalization approach was considered. 
For small systems (up to = 10) an exact enumera- 
tion was then used. For larger systems (up to A^ = 60) 
Monte-Carlo type simulated annealing and the recently 
proposed extreme optimization was applied. 

The order parameter considered by us is the r relative 
size of the largest cluster. In the thermodynamic limit r 
has the right behavior, for Jq < we get r = 0, and for 
Jo > we obtain r = 1. More precisely, r is computed 
as 



f a.(», Jo)) ) ^ 

r(Jo) =< maxi^,) i — ^ (3) 

where Cx{i, Jo) stands for the number of elements in state 

1 for an x realization of the J^ distribution, when 

< Jij >= Jq/N. Since the ground-state might be degen- 
erated (i.e. many possible configurations with the same 
minimal energy might exist) we make an average over all 
these states, denoted in (^) by the over-hne. < .... >x 
refers then for an ensemble average over Jy . 

We focus now on the simplest model in which we expect 
this transition, i.e. when Jij is a two valued quenched 
random variable, Jij = 1/N with probability q and —l/N 
with probability 1 — q (i.e. when Si — Sj = 1 and Zij is 
with a probability q and —1 with a probability I —q). 
The distribution function of the Jij values writes as 

P{J,j) = q5{J,j - l/N) + (1 - q)5{J,j + l/N), (4) 

where 5{x) denotes the Dirac functional. We assimicd 
here that the J^ links are symmetric (Jy = Jji)- It is 
immediate to realize that for this distribution: 

< J,, >= {2q l)/N, (AJ,,)2 = (5) 

In the view of our previous arguments we expect that in 
the N oo limit the r{q) curves will indicate a geomet- 
rical phase-transition at q — 1/2. 

III. RENORMALIZATION APPROACH 

Our elementary renormalization approach estimates in 
a mean-field manner the new relative size of the largest 
state, whenever the system size is doubled. We start from 
a system composed by only two elements (step 1). In the 
ground-state, the probability to have these two elements 
in the same Potts state is qi = q. The relative size of 
the largest cluster is then ri = + (1 — qi)/2, since the 
largest cluster will be the total system with probability 
qi , and the original half with probability I — qi. In step 

2 we now double the system size by linking through all 
possible Jij connections two previous configurations (A 
and B) with maximal relative size ri, each of them having 
two elements. Then, we reduce the four Jij connections 
between the elements of A and B to a single one, and 
transform the system into a configuration similar to the 
one from step 1. This procedure is summarized in Fig. 1. 
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FIG. 1. Schematics of the renormalization approach. 

The new link will be positive (+1) with probability 
12 = qi+ 4(?j*(l — qi) + 3gJ(l — gi)^, and the new relative 
size of the largest state is r2 ~ q2 + — 92)^1/2. The 
factor 3 from the last term in the expression of q2 results 
by considering the new link positive with 1/2 probability, 
whenever there are two positive and two negative links 
(6 possible realizations in total). This doubling proce- 
dure is then recursively repeated, leading to the simple 
renormalization equations: 

qk+i =qt + 4g|(l - qk) + 3ql{l - qkf, (6) 

y-fc+i = %+! + (1 - qfe+Oy- (7) 

The size of the system after k steps is TV = 2''. 

On the [0, 1] interval, iteration (^) has two stable fix- 
points: and 1. There is also an unstable fix-point 
q = 1/2. Starting the iteration from q G [0,1/2) we 
get limk^ooqk — and limj^—^aofk — 0. Choosing 
q G (1/2,1] we get limk^aoqk = 1 and limk^aork = 1- 
These results suggests that in an infinite system we have 
two distinct phases separated by qo — 1/2, as expected. 
In phase I the r order parameter converges to 0, and 
in phase II r converges to 1. We get thus the expected 
percolation-like transition as a function of q. 
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FIG. 2. Renormalization results. 



Using equations (^]^) we can also easily plot the r^q) 
curves for different system sizes. Results in this sense are 
presented in Fig. 2. These results support our previous 
arguments. 

IV. EXACT ENUMERATION 

For small system sizes {N < 10) exact enumeration 
is possible. This means that one can computationally 
map the whole phase-space (all cr{i) realizations) for a 
generated Jy configuration and determine the minimum 
energy states. Moreover, for < 7 it was also possi- 
ble to map all configurations as well, our results up 
to = 7 are thus exact. In the 7 < N < 10 interval, 
although the minimum energy states are exactly found, 
due to greatly increased computational time and mem- 
ory needed it was possible to generate only a reasonable 
ensemble average for (5000 configurations). Results 
are plotted on Fig. 3. 
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FIG. 3. Exact enumeration results for small systems. 

We performed this exact enumeration with two pur- 
poses. First, we checked the trends of the r{q) curves as 
a function of increasing system size. Secondly, these re- 
sults offer a good "standard" for our less rigorous Monte- 
Carlo type optimization methods, used for larger system 
sizes. As the results in Fig. 3 shows the r{q) curves have 
a similar trend as those suggested by our renormaliza- 
tion approach, i.e. as the system size increases we find 
increasing slopes for r(q) around a nontrivial q value. 
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FIG. 4. Average degeneration level of the ground-state (a.) 
and difference between the maximal and minimal r value for 
different coalition structures in the ground state (b.), both as 
a function of the q probability of + interactions between the 
elements. 

By exact enumeration we have also studied the degen- 
eration level of the ground state. For a given Jy bond- 
configuration, many different coahtion structure can have 
the same ground-state energy. We can define thus a w 
degeneration level for each ground-state, and for a fixed 
q value we can calculate the < w > ensemble average 
over all bond configurations. Different coalition struc- 
tures in the ground-state might be characterized by dif- 
ferent r values, as well. For a given bond configuration 
the difference between the maximal r value (rmax) and 
the minimal one (rmm) will characterize the maximal 
possible deviation in the order parameter. An ensemble 
average over this quantity (< r„iax ~ rmini will give in- 
formation about the differences which are possible to get 
in the r order parameter, while choosing another equally 
optimal coalition structure. The values of < w > and 
< i^max — fmin havc bccu Calculated as a function of the 
q parameter. The obtained results are presented in Fig. 4 



V. MONTE CARLO TYPE OPTIMIZATION 

Monte-Carlo type optimizations were used for comput- 
ing the ground-state of larger systems. We considered 
both the classical simulated annealing (T7| and the re- 
cently proposed extreme optimization method p8| . Both 
approaches are rather time-consuming and the necessary 
computational time increases sharply with system size. 
Our computational resources allowed to study systems 
with sizes up to TV = 60. 

Simulated annealing has been implemented in the stan- 
dard fashion [l^ . For the extreme optimization method 
we generalized the originally proposed method p8[ | by 
considering a two-step algorithm. In the first step we 
performed the usual optimization after the energies of 
the elements. As suggested in we assigned a given 
fitness to each Potts element and ranked all the variables 



according to their fitness. Considering the P{k) ~ k~'^ 
probability distribution over the rank, k, we then select 
an element for which the state will be changed. For this 
first step we found the optimal value of r = 0.25. In 
the second step we decide the new state of the chosen 
element by a similar procedure. For this second step the 
optimal value of r proved to be 4. 

Simulated annealing and extreme optimization gave 
identical and practically indistinguishable results. There- 
fore in Fig. 5 we plot only the simulated annealing results. 
The shape of the 



Ar{q) = \J< r'^{q) >x - < r{q) >l 



(8) 



standard deviation was also computed (Fig. 4b), suggest- 
ing a non-trivial peak. In Fig. 5 the curves for N — 10, 
20, 30 and 40 were obtained with an ensemble average 
of 5000 realizations, and the results for = 60 with a 
statistics of 1000 realizations. For A^ = 10 the Monte- 
Carlo type results are in perfect agreement with the ones 
from exact enumerations (Fig. 5a), giving confidence in 
the used stochastic simulation methods. 




FIG. 5. Monte-Carlo optimization results: (a.) variation 
of the order parameter, (b.) standard deviation of the order 
parameter as a function of q. For comparison purposes on 
Fig. 4a the exact enumeration results for A'^ = 10 are also 
shown (continuous line). 

Our estimates suggest that extreme optimization was 
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faster by a factor of at least two, in comparison with 
simulated annealing. However, we found that extreme 
optimization is also strongly affected by the increasing 
system size, and for TV > 60 we couldn't get any good 
statistics in reasonable computational time. 

The results plotted in Fig. 5 support the expected ge- 
ometrical phase transition in the system. As the sys- 
tem size increases the r(g) curves show a more and more 
sharper trend in the vicinity oi q = 1/2. Also, the ^r{q) 
standard deviation exhibits a non-trivial peak, which gets 
sharper and closer to g = 1/2 as the system size increases. 
By extrapolating the obtained results as a function of N 
for q = 0.1, q = 0.3 and q — 0.7, one can show that 
r ^ as a power-law for q = 0.1 and q = 0.3, and r ^ 1 
for q = 0.7 (Fig. 6). This proves the existence of the 
presumed phases. 

Dropping the symmetry requirement for introduces 
an extra frustration in the system. While for symmet- 
ric Jij only subsets with more than two elements can 
be frustrated, in the asymmetric case subsets of two ele- 
ments can become already frustrated. It is interesting to 
note however, that the nature of the observed transition 
is not affected by dropping this symmetry requirement 
and again, the same geometrical phase transition should 
appear in qc = 1/2. Up to = 10 we computed the r{q) 
curves by exact enumerations and for A = 20 and 30 we 
used the extreme optimization method. No important 
deviations from the symmetric case were found. 
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ln(N) m 

FIG. 6. Finite-size scaling (log-log plots) for (a.) q 

and q = 0.3 (b.) q = 0.7. The best-fit lines for (a.) 

slopes of —0.714 and —0.4928, respectively. 
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VI. A MORE GENERAL CASE 

Next, we briefly present our results for a more general 
case, where the Si factors are also randomly distributed. 
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FIG. 7. Simulated annealing results for uniformly dis- 
tributed Si values, (a.) variation of the order parameter, 
(b.) standard deviation of the order parameter as a function 
of q. 

Considering a simple uniform distribution of the Si val- 
ues on the [0, 1] interval and Zij distributed according to 
the (^ distribution, we performed a simulated annealing 
optimization. Since the variance of Jij scales again like 
N~'^, the transition is naturally expected. For A^ = 10, 20 
and 40 results supporting this geometrical phase transi- 
tion are plotted on Fig. 7. 



VII. DISCUSSIONS 

The observed geometrical phase transition is interest- 
ing also from the viewpoint of the much discussed social 
percolation [|l^ , where the emergence of a giant cluster is 
observed in many social phenomena. Our simple model 
suggests that large sociological systems can show tenden- 
cies to percolation-like behavior due to coalition forma- 
tion phenomena. If a globally coupled large system has 
more propensities pointing towards collaboration than 
conflict, usually a single coalition satisfies optimally the 
apparently conflicting interactions. Contrary, when there 
are more conflicting propensities than collaborative ones, 
the society will fragment in large number of coalitions, 
and each element will isolate itself from the others. As 
expected, this percolation-like behavior is rather smooth 
for small systems sizes. The observed percolation-like be- 
havior is also quite stable relative to the choice of the Zij 
propensities and Si weight-factors. 
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It is also important to mention that according to the 
considered model the most impredictable societies are the 
"equilibrated" ones, where the number of positive and 
negative links are roughly the same. From our numerical 
results one can see that in this case Ar is big, and the 
value of r is changing strongly with small variations of q. 
First, this means that the system is very sensitive to the 
explicit realization of the Jij values. Secondly, as seen in 
Fig. 4 in this region many equilibrium configurations with 
different r values might co-exist, all of them having the 
same minimal K value (degeneracy of the ground-state 
might be high). Third, a small difference in the measured 
q value can result in large differences for the expected r 
values. In these " equilibrated" societies statistical meth- 
ods are useless for predicting the optimal clusterization. 
Specific analyses of the concrete situation is thus the only 
acceptable prediction method. 

The fact that in the ground-state many equally- 
optimum configurations with quite different maximal 
cluster sizes are possible might also lead to interesting 
implications. It might well be possible the existence of 
some "mixed" states, where the system behavior can be 
described not from a clear coalition structure, but rather 
from a superposition of many coalition structures. 

The model considered by us is of course a very simple 
one, capturing only a few parameters that are important 
in understanding social coalition formation. In our model 
we have also neglected the dynamics of the system, and 
presumed that the system will clusterize in one of the op- 
timal configurations. The system is however frustrated, 
and many configurations with local minimum exist. Dur- 
ing its dynamics, the system might get trapped in a local 
minimum, and the formed coalitions might be the one 
corresponding to this case, rather than the global opti- 
mum case. The model considered by us and our results 
are usable thus only for statistically predicting the opti- 
mal clusterization, and not for understanding the coali- 
tions that are formed in reality. 

In conclusion, in the present study we presented evi- 
dences for a geometrical phase transition in the ground- 
state of an infinite-range Potts glass where the standard 
deviation of the bonds scale as N^"^. For finite system 
sizes three different methods were used to approach this 
NP hard optimization problem, all of them supporting 
the percolation-like behavior of the largest cluster size 
as a function of the positive links in the system. The 
model considered by us might be useful in understanding 
some social percolation phenomena in large sociological 
systems. 
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